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ADVERTISEMENT SWAPPING USING AN AGGREGATOR FOR AN 
INTERACTIVE TELEVISION SYSTEM 

TECHNICAL FIELD 

5 

This disclosure relates generally to interactive television systems, and 
in particular but not exclusively, relates to use of an aggregator in connection with 
advertisement swapping in an interactive television system. 

10 BACKGROUND 

A growing number of television content sources enable interactive 
television. When operational, interactive television provides useful e-commerce, 
advertising, and information capabilities to viewers. One mechanism for interactivity 

15 typically involves the insertion of information or data in hidden portions of a 
television video signal. This Information can range from a simple web link, such as 
an Internet uniform resource locator (URL) address, to a fairly complete set of 
extensible markup language (XML) information that can form a complex web page 
accompanied by web links {e.g., to advertisers' web pages). Advanced Television 

20 Enhancement Forum (ATVEF) triggers or triggering techniques by Wink are 
examples of mechanisms for providing interactive information along with television 
signals. 

This Information {e.g., triggers and accompanying content and data, 
which will be referred to collectively herein as "trigger information") is typically 
25 inserted or carried in a vertical blanking interval (VBI) portion of an analog television 
video signal. For digital television broadcasts, this trigger information may be 
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inserted into a special data slice of an MPEG-2 bit stream or signal. Modern 
analog/digital set top boxes or other client terminals can decode tliese signals to 
obtain the trigger information, and with the appropriate enabling software, convert 
the trigger information into a rich interactive experience for the viewer. 
5 Unfortunately, typical television systems leave the interactive 

experience under the exclusive control of content providers. The cable service 
provider or multiple system operator (MSO) has limited opportunity to customize or 
enhance that experience for the viewer. In other words, because the content 
providers are typically the parties that provide and insert the trigger information into 

10 the television signals, the MSO's role is often reduced to simply relaying the 
television signals to viewers without any modification or customization. 

An area where this limitation can cause problems is in television 
advertising. Because the content providers generally provide the television signals 
having the embedded triggers (which correspond to advertisements present in the 

15 television signal), current techniques for advertisement substitution (or 
"advertisement swapping") may be difficult to implement, due to the technical 
differences between interactive television and conventional television and due to 
many MSOs' limited capability to modify television content provided from content 
providers. For example, simply swapping a national commercial with a local 

20 commercial (so that specific local retail merchant information can be provided to the 
viewer, for instance) is more easily said than done in an interactive television 
environment, given factors such as ensuring that URL addresses are consistent and 
correct, the capabilities of subscribers' terminals to recognize and process 
interactive content, licensing considerations, and so on. 

25 Accordingly, improvements are needed in techniques for providing 

advertisements to interactive television viewers. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Non-limiting and non-exhaustive embodiments of the present invention 
are described with reference to the following figures, wherein like reference 
5 numerals refer to like parts throughout the various views unless othenwise specified. 

Figure 1 is a block diagram of a system that can implement an 
embodiment of the invention. 

Figure 2 is a block diagram illustrating an example of an aggregation 
technique for advertisement swapping for the system of Figure 1 in accordance with 
10 an embodiment of the invention. 

Figure 3 is a block diagram illustrating examples of aggregation 
techniques for advertisement swapping for the system of Figure 1 in accordance 
with another embodiment of the invention. 

Figure 4 is flowchart illustrating an embodiment of advertisement 
15 swapping that can be conducted at a subscriber residence in the system of Figure 1 . 

Figure 5 is flowchart illustrating an embodiment of advertisement 
swapping that can be conducted at a head-end in the system of Figure 1 . 
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DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS 



Embodiments of a system and method to use an aggregator in an 
interactive television system in connection with advertisement swapping are 

5 described herein. In the following description, numerous specific details are given to 
provide a thorough understanding of embodiments of the invention. One skilled in 
the relevant art will recognize, however, that the invention can be practiced without 
one or more of the specific details, or with other methods, components, materials, 
etc. In other instances, well-known structures, materials, or operations are not 

10 shown or described in detail to avoid obscuring aspects of the invention. 

Reference throughout this specification to "one embodimenf or "an 
embodiment" means that a particular feature, structure, or characteristic described 
in connection with the embodiment is included in at least one embodiment of the 
present invention. Thus, the appearances of the phrases "in one embodiment" or "in 

15 an embodiment" in various places throughout this specification are not necessarily 
all referring to the same embodiment. Furthermore, the particular features, 
structures, or characteristics may be combined in any suitable manner in one or 
more embodiments. 

As an overview, one embodiment of the invention provides an 

20 interactive information aggregation presence on the Internet or other location for off- 
broadcast transmission of advertisement swapping trigger information, which can 
include interactive television triggers, accompanying content and data, addresses 
such as URL addresses, and the like. An embodiment of the invention can be 
implemented as an interactive television system that can perform real-time 

25 aggregation of trigger information for advertisement swapping through cooperation 
with content providers or via reception of trigger information (including interactive 
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content) provided by third-party entities. The aggregated information can be used to 
perform advertisement swapping, such as by switching to a channel that carries 
substitute advertisements or by retrieving substitute advertisements (including 
overlay information) from a storage location. The advertisement swapping can also 
5 include replacement of links (such as URL links) that are present in the original 
advertisement with substitute links. 

Referring first to Figure 1, shown generally at 10 is an interactive 
television system that can implement an embodiment of the invention. The system 
10 includes one or more broadcast centers, such as head-ends 12 for a cable 

10 distribution system or broadcast centers for a satellite delivery system (described 
below), to distribute television broadcast content and interactive television 
(sometimes referred to as "ITV") content to a plurality of subscriber residences 14. 
The head-end 12 includes broadcast content processing and iTV services hardware 
and software (including processors, servers, storage media, databases, and so on), 

15 which are shown generally in Figure 1 as a unit 16. The unit 16 can receive national 
broadcast content and iTV content 18 from content providers, satellite feeds, 
servers, or other sources. The unit 16 can also receive local broadcast content and 
ITV content 20 from parties such as local studios, servers, content providers, or 
other sources. The content 18 and 20 can include original advertisements (such as 

20 commercials) to be broadcast, including interactive content in the advertisements 
(such as URL addresses or other links). 

A cable modem termination system (CMTS) 22 provides the head-end 
12 (and ultimately the subscriber residences 14) with access to the Internet 24. A 
combiner 26 places the signals and/or data provided by the unit 16 and the CMTS 

25 into appropriate channels of a communication network 28. In accordance with an 
embodiment of the invention, the communication network 28 can comprise a hybrid 



5 



Attorney Docket: 005217.P055 

fiber-coaxial cable distribution network comprising channels having a bandwidth of 6 
MHz. Some of these channels of the communication network 28 are used to carry 
television signals (which may be accompanied by interactive content and other 
trigger information), while other channels are used for upstream and downstream 

5 communication of data with the Internet 24. Some other channels (sometimes 
referred to as "out-of-band" channels) of the communication network 28 may be 
used to carry electronic program guide (EPG) information. In one embodiment of 
the invention, at least one of these out-of-band channels may be used to carry 
advertisement information, such as graphics, information for overlays, media files, 

10 and so on, and may be used for carrying trigger information for advertisement 
swapping as well. 

Examples of techniques that can be used to provide interactive content 
and other trigger information from the unit 16 to set top boxes in the subscriber 
residences 14, via channels of the communication network 28, include MPEG 

15 methods that multiplex special data stream(s) into the digital video transport stream, 
encoding/embedding data in the VBI portion of the analog television video signals 
{e.g., ATVEF triggers), using out-of-band modems {e.g., Digital Audio-Visual Council 
or "DAVIC" modems) to provide the interactive content, and other such techniques 
that provide information related to the content of the television signals. For the 

20 channels of the communication network 28 that are used for communication of data 
to and from the Internet 24, protocols such as Data Over Cable Service Interface 
Specifications (DOCSIS), transmission control protocol/Internet protocol (TCP/IP), 
hypertext transfer protocol (HTTP), file transfer protocol (FTP), or other suitable 
protocols/techniques may be used. 

25 At the residence 14, a splitter 30 is coupled to receive the television 

signals (including interactive content and other trigger information) from the 
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communication network 28. The splitter 30 sends the received television signals 
(including interactive content and other trigger information) to a first client terminal, 
such as a set top box 32, which subsequently sends the signals and other 
information to a television 34. As will be understood by those skilled in the art, the 

5 set top box 32 includes components such as digital/analog video processing unit(s), 
VBI decoders, central processing units, memory, video graphics processing unit(s), 
software, and other components that can detect, extract, and process trigger 
information and other interactive content that is received from the communication 
network 28. For instance, these components can extract URL addresses from the 

10 trigger information and present the URL addresses as hypertext links or other visual 
indicator on the television 34, which the viewer can "click" to connect to the Internet 
24. These components and the specifics of their operation are not shown in Figure 
1 or described in further detail herein for the sake of simplicity of explanation. 

In accordance with one embodiment of the invention, the set top box 

15 32 can include or be coupled to a storage unit 35. The storage unit 35 can comprise 
a machine-readable storage medium such as a cache, buffer, memory, diskette, 
compact disk, tape, flash memory, random access memory (RAM) or the like and 
their associated hardware, in one embodiment. In an embodiment the storage unit 
32 can comprise a hard disk such as a digital or personal video recorder (DVR or 

20 PVR). Alternatively or in addition, a storage unit 37 may be coupled to or comprise 
part of the unit 16 at the head-end 12 (or othenwise be communicatively coupled to 
other components of the head-end 12). 

Typically, a viewer of the television 34 can view television programs 
and experience Interactive television via use of a remote control (not shown) that 

25 communicates with the set top box 32. Examples of such interactivity with the 
television 34 and set top box 32 include being presented with or accessing 
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supplementary information that may accompany a television program by "clicking" 
on an on-screen icon that is displayed via use of triggers, conducting e-commerce 
by clicking on on-screen menus or icons that are activated by triggers, navigation of 
the set top box 32 to a URL address on the Internet 24 in response to the viewer's 

5 "clicking" of an on-screen icon, and so on. 

In some embodiments, the splitter 30 can be coupled to a cable 
modem 36. With basic embodiments of the splitter 30, the cable modem 36 
receives the same input as the set top box 32 {e.g., receives the same television 
signals). With more complicated embodiments of the splitter 30, the cable modem 

10 36 and the set top box 32 may receive different channels. Whether receiving the 
same or different channels from the splitter 30, a primary function of the cable 
modem 36 is to provide one or more ancillary devices 38 with access to the Internet 
24. Examples of the ancillary device 38 can include, but not be limited to, PCs, 
wireless handheld devices, companion set top boxes, two-way advanced remote 

15 controls, or other browser-enabled display devices or client terminals that have the 
capability to communicate with the Internet 24. The ancillary device(s) 38 can 
include or be coupled to the storage unit 35 (or other storage unit). 

Thus, for instance, the cable modem 36 can use the DOCSIS protocol 
to allow the user of the ancillary device 38 to "surf" the Internet, regardless of 

20 whether or not television programming is currently being concurrently displayed on 
the television 34. Indeed, many subscribers prefer to use cable modems as their 
method of access to the Internet 24, rather than or in addition to, a telephone 
modem, a digital subscriber line (DSL), and the like. 

In an embodiment of the invention, advertisement swapping may be 

25 performed such that the set top box 32 and/or the ancillary device 38 renders for 
display a substitute advertisement instead of (or in addition to, such as via an 
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overlay) an originally broadcasted advertisement. According to various 
embodiments, the substitute advertisements may be available on a separate 
channel of the communication network 28, from the storage unit 35, from a storage 
unit at the head-end 12, or from some other location. An aggregator 40 can 

5 aggregate trigger information, in an embodiment, that can cause the advertisement 
swapping to occur. 

That is, an embodiment of the invention provides the aggregator 40 
that can aggregate trigger information to accompany television broadcasts. Such 
trigger information allows recognition of original broadcast advertisements that are 

10 designated for swapping, and then causes the swapping of the original broadcast 
advertisements with substitute advertisements. This trigger information can include 
triggers, interactive content, URL and other addresses, links, hypertext markup 
language (HTML) pages, streaming media, files, or other information or combination 
thereof. 

15 The trigger information for advertisement swapping can be provided by 

the aggregator 40 to the cable modem 36 in a format that the ancillary devices 38 
can process. The aggregated information can be collected/aggregated and at least 
some provided to the cable modem 36 concurrently {e.g., in "real-time") with the 
corresponding television program that is provided to the set top box 32 and the 

20 television 34. Moreover, at least some of the aggregated information can be 
provided at other times, such as in response to a request for the information sent 
from the ancillary device 38 or set top box 32 (which may not necessarily be 
concurrent with the presentation of the television program on the television 34). The 
aggregator 40 can also provide this trigger information to the set top box 32, 

25 alternatively or in addition to the ancillary devices 38, so that the set top box 32 can 
be involved in the advertisement swapping. 

9 
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In accordance with an embodiment of the invention, the aggregator 40 
can include a combination of hardware and software (such as one or more 
processors, one or more servers, databases and other storage media, software and 
other machine-readable instructions stored on a machine-readable medium, and so 

5 on) that delivers its aggregated content via at least one of the channels of the 
communication network 28, using the DOCSIS protocol as an example, to the 
ancillary devices 38 connected to the cable modem 36. The aggregator 40 can be 
located in the head-end 12 in one embodiment, while in other embodiments, the 
aggregator 40 can be located outside of the head-end 12, including somewhere in 

10 the Internet 24. In several example implementations where the aggregator 40 
operates to provide URL addresses (or other interactive information peculiar to the 
Internet 24) to the ancillary devices 38, the aggregator 40 can be communicatively 
coupled to the CMTS 22 in accordance with an embodiment of the invention, so that 
the aggregator 40 can provide such information to the ancillary devices 38 via the 

15 CMTS 22. 

It is to be appreciated that the aggregator 40 need not necessarily be 
coupled to the CMTS 22 in some embodiments, so long as the aggregator 40 can 
deliver aggregated information that can be used by the ancillary device 38 and/or 
the set top box 32 for advertisement swapping. For instance, the aggregator 40 can 

20 deliver the aggregated information to the ancillary devices 38 via a non-cable 
modem connection (such as telephone line, DSL, or other network different from the 
communication network 28) that the ancillary devices 38 may have with the Internet 
24. Alternatively or in addition to being coupled to the CMTS 22, the aggregator 40 
can be coupled to or comprise part of the unit 16, as depicted in Figure 1 . In such 

25 an embodiment, the aggregator 40 can provide the trigger information to the unit 16 
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SO that advertisement swapping may be performed by the unit 16 by way of channel 
switching to a channel that carries substitute advertisements. 

Various techniques can be used by the aggregator 40 to aggregate 
trigger information and to eventually provide this trigger information to the ancillary 
5 devices 38, set top box 32, and/or the unit 16 for purposes of advertisement 
swapping. Examples of these techniques are illustrated in the subsequent figures, 
and generally include receiving the trigger information from third-party entities, direct 
network links from the unit 16 to the aggregator 40, or direct feeds from content 
providers to the aggregator 40. 

10 Figure 2 is a block diagram illustrating an example of an information 

aggregation technique for the system 10 of Figure 1 in accordance with one 
embodiment of the invention. In the embodiment of Figure 2, a third-party entity 48 
provides advertisement swapping trigger information to the aggregator 40. An 
example of the third-party entity 48 can include a service that is licensed to generate 

15 triggers and to provide these triggers to an MSO or other operator of the head-end 
12. For instance, the third-party entity 48 may be contracted with the MSO and with 
Company A to generate trigger information to swap Company A's advertisements in 
place of Company B's advertisements in the television signals broadcasted from the 
head-end 12 {e.g., a "Swap Company A into Company B" trigger). The third-party 

20 entity 48 may also provide other types of interactive content to the aggregator 40, 
including trigger information in the form of URL and other addresses, links, HTML 
pages, streaming media, and so on. 

When the aggregator 40 has received the information from the third- 
party entity 48, the information can be stored or aggregated in storage media in the 

25 aggregator 40. This aggregation at the aggregator 40 can involve activities such as 
recording characteristics related to the trigger information, such as the type of 



11 



Attorney Docket: 005217.P055 

information received, the advertisement to be swapped and channel, dates and 
times of transmission, the expiration date(s) of the trigger information, and other 
such data that correlate the substitute advertisement with the original advertisement. 
Aftenwards, the aggregated information can be broadcasted, IP multicasted, or 

5 unicasted from the aggregator 40 to one or more client terminals in one or more 
subscriber residences 14. In accordance with an embodiment of the invention, the 
aggregated trigger information can be sent to the ancillary device 38 by way of the 
CMTS 22, through a channel of the communication network 28 that uses the 
DOCSIS protocol, and then to the cable modem 36. Alternatively or in addition, an 

10 out-of-band channel may be used to send the aggregated trigger information from 
the aggregator 40. 

In accordance with an embodiment of the invention where the 
advertisement swapping occurs at the subscriber residence 14 (rather than at the 
head-end 12), the aggregated information can be transmitted {e.g., broadcast, 

15 multicast, or unicast) to the ancillary device 38 (or to the set top box 32) from the 
aggregator 40 in real-time and concurrently with original advertisements that are 
sent via television signals from the head-end 12. The information provided by the 
third-party entity 48 to the aggregator 40 can be pre-formatted or pre-configured by 
the third-party entity 48 in a manner that is recognizable to the ancillary devices 38 

20 in one embodiment. 

Alternatively or in addition, the aggregated trigger information can be 
sent for storage in the storage unit 35 (or other local storage unit) at times that are 
different from the broadcast times of the original advertisements. Then, incoming 
television signals from the head-end 12 are monitored and compared with the stored 

25 trigger information to determine if advertisements in the television signals are 
appropriate for swapping. This process will be described later below. 

12 
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Figure 3 is a blocl< diagram illustrating additional examples of 
information aggregation teciiniques fortfie system 10 of Figure 1 in accordance witli 
an embodiment of tlie invention. iVIore specifically, Figure 3 illustrates direct 
network link(s) 42 from the unit 16 to the aggregator 40, and direct feeds 44 and 46 
5 from content providers {e.g., providers of national broadcast content and iTV content 
18 and providers of local broadcast content and iTV content 20, respectively) to the 
aggregator 40. 

With regards to the link 42, the unit 16 can provide trigger information 
and other related content directly to the aggregator 40. Because the unit 16 is 

10 coupled to receive television signals and information for eventual transmission via 
the channels of the communication network 28, the unit 16 can obtain trigger 
information from all incoming television signals where such interactive data is 
present and is capable of being used for advertisement swapping. Such an 
embodiment of the link 42 can be implemented, for instance, in situations where the 

15 hardware and software of the unit 16 has extracted or othenwise obtained substitute 
trigger information from content providers and/or television signals. Then, this 
substitute trigger information can be provided directly to the aggregator 40 after the 
unit 16 has processed the information or othenwise configured the information to a 
format that is suitable for the ancillary devices 38 or for the set top box 32. 

20 With regards to the direct feeds 44 and 46 of Figure 3, the content 

providers can provide substitute trigger information directly to the aggregator 40. In 
an embodiment, the information provided via the direct feeds 44 and 46 to the 
aggregator 40 can be pre-formatted or pre-configured by the content providers in a 
manner that is recognizable to the ancillary devices 38 or to the set top box 32. 

25 Illustrative examples of the information that can be provided to the aggregator 40 via 
the direct feeds 44 and 46 include the substitute advertisement itself, triggers used 
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by the ancillary device 38 and/or the set top box 32 to determine if an original 
advertisement is to be substituted, URL addresses indicative of locations of 
substitute interactive content, interactive content that is to accompany the substitute 
advertisements, and the like. 
5 Once the information is received via the direct feeds 44 and 46, the 

aggregator 40 can aggregate and deliver the information to the ancillary devices 38 
and the set top box 32 via the techniques described above for the embodiment of 
Figure 2. It is to be appreciated that in one embodiment, both the direct link 42 and 
the direct feeds 44 and 46 may be used to provide advertisement swapping trigger 

10 information and other substitute interactive content to the aggregator 40. 

The embodiments shown in Figures 2-3 have been generally 
described above in the context of providing trigger information to the ancillary 
devices 38 and/or to the set top box 32 such that these devices can be the primary 
devices for performing advertisement swapping. It is to be appreciated that the 

15 trigger information for advertisement swapping may also be provided by the 
aggregator 40 to the unit 16 of the head-end 12, so that the unit 16 may be the 
primary component for initiating advertisement swapping. Figures 4 and 5 are 
flowcharts illustrating advertisement swapping that can be performed at the 
subscriber residence 14 and/or at the head-end 12, respectively, according to 

20 embodiments of the invention. Elements of these flowcharts may be embodied in 
software or other machine-readable instructions stored on a machine-readable 
medium, such as the storage unit 35 or storage unit at the head-end 12 or 
aggregator 40. 

The flowchart of Figure 4 illustrates an embodiment of advertisement 
25 swapping that may be performed by device(s) at the subscriber residence 14 (such 
as by the set top box 32, ancillary devices 38, storage unit 35), in cooperation with 
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the aggregator 40 and the head-end 12. Beginning first at a blocic 50, subscribers 
are opted-ln by the cable service provider or MSO. Stated in another way, 
subscribers who wish to receive substituted advertisement services can specifically 
request that service. One technique for recording opted-in subscribers is to store 
5 set top box identification codes or other subscriber identification data in a database. 
When advertisement swapping is to occur, a lool<up of this database can be 
performed to determine which subscribers are to receive substitute advertisements, 
advertisement swapping trigger information, and so on. 

It is to be appreciated that in other embodiments, an MSO or other 
10 party may perform advertisement swapping on a subset of the subscribers without 
the subscribers' knowledge. Such situations may occur, for example, in order to 
provide targeted advertising. Therefore, in this case, advertisement swapping 
occurs without a subscriber necessarily having "opted-in." 

Next at a block 52, at least some of the substitute advertisement 
15 content is sent to the subscriber residence for storage, such as in the storage unit 
35. Examples of such substitute advertisement content can include, but not be 
limited to, substitute advertisements (such as audio and video clips), URL addresses 
or other addresses associated with locations of interactive content, graphics and 
other information for overlays, media files, and the like. This content can be sent to 
20 the storage unit 35 via a DOCSIS channel, out-of-band channel, other channel of 
the communication network 28, or via a network different from the communication 
network 28, such as a DSL line. The content can also be updated as needed via 
use of expiration codes or by sending new content to replace old content. 

At a block 54, the aggregator 40 aggregates trigger information, such 
25 as via the techniques shown in Figures 2-3. This trigger information can include 
real-time triggers provided by the third-party entity 48 to swap a received broadcast 
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advertisement with a substitute advertisement stored in the storage unit 35 at the 
block 52. At a block 56, the aggregated trigger information is sent by the aggregator 
40 to the subscriber residence 14 {e.g., to the ancillary devices 38 via DOCSIS and 
the cable modem 36 and/or to the set top box 32). If real-time aggregated trigger 

5 information is being sent from the aggregator 40, then the set top box 32 and/or the 
ancillary devices 38 can receive the aggregated trigger information for 
advertisement swapping concurrently with the advertisements that are to be 
swapped. Moreover, it is to be appreciated that what is shown in the blocks 52-56 
of Figure 4 can be combined operations in some embodiments of the invention. 

10 Next at a block 58, software or other application of the set top box 32 

or the ancillary device 38 monitors the television signal broadcasts received from the 
head-end 12. Specifically, the television broadcast is monitored for triggers that 
identify the advertisements to be replaced, and for triggers in the broadcast that 
demarcate the beginning and end of the broadcast advertisements, if such 

15 demarcating triggers are present. The monitored trigger information in the television 
signal is compared with the stored trigger information at a block 60. 

If an advertisement to be swapped is identified (such as if the trigger 
information in the television signal matches the stored trigger information received 
from the aggregator 40), then advertisement swapping is performed at a block 62. 

20 In embodiments where the trigger information is received in real-time from the 
aggregator 40 {e.g., concurrently with the corresponding advertisements in the 
broadcast television signal), advertisement swapping can be performed 
automatically without having to perform the comparison at the block 60. For 
instance, if it is determined that the set top box 32 is tuned to a particular channel at 

25 a particular time that real-time substitute trigger information is received from the 



16 



Attorney Docket: 005217.P055 

aggregator 40, then advertisement swapping can be performed on the 
corresponding advertisement that is currently being broadcasted. 

Several techniques can be performed to provide advertisement 
swapping at the block 62. One technique is to switch the input to the television 34 
5 (or the input to a display of the ancillary device 38), such that the input is in the form 
of a substitute advertisement from the storage unit 35 rather than the original 
broadcast advertisement. After the substitute advertisement has finished playing, 
the input to the television 34 can be switched back to the original broadcast. 

Another technique is to switch a tuner of the set top box 32 or the 

10 ancillary device 38 to a specific channel of the communication network 28 where 
substitute advertisements are carried. This channel switching may be performed by 
software in one embodiment, in response to identification of advertisements that are 
to be swapped (or identification of their triggers). Alternatively or in addition to 
channel switching, data or graphics stored in the storage unit 35 may be retrieved 

15 and then overlaid over the broadcast advertisement after the broadcast 
advertisement is identified as one that is to be replaced. Picture-in-picture 
arrangements can also be used to provide this overlay. The overlay information can 
include local advertisements, substitute URL addresses, screen prompts, and so on. 

In yet another embodiment, such content can be delivered over the 

20 communication network 28 or other network (e.g., via streaming audio or video clips 
from an Internet site or a dedicated headend server). The set top box 32 receives 
and decodes the content/information, and then swaps or overlays it with the live 
broadcast. 

In accordance with an embodiment of the invention, the advertisement 
25 swapping at the block 62 can include swapping of links. For instance, if there are 
URL links in the triggers of the original advertisements that need to be replaced, the 
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substitute advertisements can provide substitute URL links in their triggers. Wlien 
the substitute advertisements are displayed to the viewer along with the substitute 
links, the viewer can click on the substitute links to receive substitute interactive 
content {e.g., can link to a web site of the substitute advertiser). In this manner, the 

5 viewer is never presented with and never sees the original links. Upon clicking the 
substitute link, the viewer can experience interactivity at a block 64. 

In another embodiment, the viewer can be presented with and can 
click on an original link. Then, the swapping of links can be performed by an 
application of the set top box 32 or ancillary device 38 by way of redirection to an 

10 address corresponding to a substitute link. For the viewer, this redirection can be 
performed transparently. Thereafter, substitute interactive 

content/advertising/experience can be provided to the viewer at the block 64, via a 
DOCSIS connection (for example) to the Internet 24 by way of the CMTS 22. 

In yet another embodiment, the original links themselves can be 

15 replaced prior to being provided to the television 34 or to a display of the ancillary 
device 38. For instance, if the audio and video segment of the original 
advertisement is to be maintained, but the original links are to be replaced with 
substitute links, hardware and software of the set top box 32 or ancillary devices 38 
can perform processing to extract the original links from the television signal. Then, 

20 these extracted links can be discarded and substitute links can be provided in their 
place for display on the television 34. 

The flowchart of Figure 5 illustrates an embodiment of advertisement 
swapping that may be performed by the unit 16 of the head-end 12 or at some other 
broadcast center, in cooperation with the aggregator 40. Beginning at a block 66, 

25 subscribers can be opted-in for the advertisement substitution service, such that 
only opted-in subscribers receive substitute advertisements in one embodiment. In 
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another embodiment, the opting-in at the block 66 need not be performed, resulting 
in all subscribers receiving the substitute advertisements. Next at a block 68 (similar 
to the block 52 of Figure 4), at least some of the substitute content (such as 
substitute advertisements) is sent to a storage unit of the head-end 12 for storage, 

5 such as to the storage unit 37. Also similar to the blocks 54 and 56 of Figure 4, 
trigger information is aggregated by the aggregator 40 at a block 70 but is instead 
sent to the head-end 12 for storage at the block 72. 

Next at a block 74, the unit 16 monitors the incoming television signal 
feeds from the sources 18 and 20, and compares the trigger information in these 

10 television signals with the stored trigger information at a block 76. If there is a 
match {e.g., triggers of advertisements to be swapped match the triggers of the 
substitute advertisements, as determined by a database lookup in the storage unit 
37, for instance), then advertisement swapping occurs at a block 78. As before, 
several techniques can be used to perform advertisement swapping at the block 78. 

15 One technique is to extract (from the television signal) the original 

triggers corresponding to the original advertisements, and then replace the original 
triggers in the television signal with substitute triggers (having substitute URL links 
for instance). Various trigger extraction and insertion hardware, software, and 
techniques may be used to perform this operation. 

20 Another technique uses the unit 16 to perform channel switching upon 

identification of an advertisement to be swapped. For example, the unit 16 can use 
a lookup table to identify the substitute advertisement to swap in place of a 
broadcast advertisement, and then switch an output feed from the head-end 12 
such that the substitute advertisement is broadcast instead of the original 

25 advertisement. This output feed from the head-end 12, in one embodiment, can be 
by way of a channel that carries the substitute advertisement, which itself may be 
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sourced from the storage unit 37 in the head-end 12 that stores the substitute 
commercial (as referenced at the block 68). in another embodiment, this output 
feed from the head-end 12 can be an override of the original advertisement with the 
stored substitute advertisement, on the original channel. 

5 As with the block 62 of Figure 4, links in the original advertisements 

can be replaced at the block 78. One technique is to completely replace the original 
links with new links, which can be done inherently when replacing the original 
advertisements with the substitute advertisements or when selectively replacing 
original triggers/links in the television signal with substitute triggers/links while 

10 maintaining the original audio and video portion of the original advertisement. Other 
techniques include the insertion of substitute triggers that have redirection 
commands. These triggers can be inserted in the original television signal as 
completely new triggers, or existing triggers may be modified to have this redirection 
command added. 

15 As mentioned above, the substitute advertisement may be broadcast 

to all subscribers or to just opted-in subscribers. To selectively send to opted-in 
subscribers, the client terminals {e.g., set top boxes 32) of opted-in subscribers may 
be enabled at a block 80. For instance, a look-up technique can be used to 
determine opted-in subscribers, and then, a code can be sent from the head-end 

20 12, via DOCSIS or an out-of-band channel, to instruct the set top box 32 of opted-in 
subscribers to tune to the channel where the substitute advertisements are carried. 
The set top boxes of non-opted-in subscribers either do not receive this code, or 
would be unable to process it. 

In conclusion, the aggregator 40 is provided in connection with 

25 advertisement swapping. The aggregator 40 can be implemented in the interactive 
television system 10 so as to perform real-time aggregation of trigger information for 

20 
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advertisement swapping through cooperation with content providers or third-party 
entities 48, or a combination of these resources. The aggregated information can 
then be made available to set top boxes 32 and/or ancillary devices 38. 
Advertisement swapping may be performed via channel switching to a channel that 
5 broadcasts substitute advertisements or by retrieving substitute advertisements from 
the storage unit. The advertisement swapping may be performed by devices of 
opted-in subscribers, or by devices at the head-end 12. The advertisement 
swapping can also include replacement of original links in the advertisements with 
substitute links, so that the viewer can experience interactivity and/or receive 

10 interactive content associated with the substitute links. The substitute 
advertisements may be swapped during a time period of the original 
broadcast/advertisement that substantially correspond to beginning and end 
locations of the advertisement that may be demarcated by the original triggers. In 
this manner, the substitute advertisement may be inserted without any noticeable 

15 clipping, "blips," or blank images that may otherwise occur if the substitution 
occurred at improper segments of the broadcast. 

The above description of illustrated embodiments of the invention, 
including what is described in the Abstract, is not intended to be exhaustive or to 
limit the invention to the precise forms disclosed. While specific embodiments of, 

20 and examples for, the invention are described herein for illustrative purposes, 
various equivalent modifications are possible within the scope of the invention, as 
those skilled in the relevant art will recognize. 

For instance, while the various figures and accompanying description 
illustrate set top boxes and ancillary devices 38 as being present and used in 

25 subscriber residences, it is to be appreciated that such devices can be used in other 
locations where interactive television reception is available, such as offices, libraries, 
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schools, airports, and so on. Therefore, the invention is not limited by the specific 
location of any one of the ancillary devices 38 and/or set top boxes. Furthermore, 
while the various figures illustrate only a single set top box and ancillary device in 
each subscriber residence, it is to be appreciated that there may be multiple 
5 numbers of these devices in any one location. 

Additionally, while the terms "aggregation" or "aggregator" is used 
throughout this description and in the claims, these terms are not intended to 
necessarily require a timing element or time constraint. That is, in some 
embodiments, "aggregation" or "aggregator" can include situations where trigger 

10 information is collected by the aggregator 40 and then delivered to the ancillary 
devices 38 or set top box 32 without any substantive time delay caused by storage 
prior to delivery. In effect, the trigger information is delivered to the ancillary devices 
38 in what appears to be real time to the viewer. In other embodiments, 
"aggregation" or "aggregator" can include situations where the trigger information is 

15 actually collected and stored for later delivery, such as in response to the viewer's 
browser request for the trigger information, and hence a timing element can be 
involved. 

Moreover, alternatively or in addition to a cable distribution system, a 
satellite television (TV) delivery system may be implemented. A satellite TV delivery 

20 system may comprise a direct broadcast satellite (DBS) system. A DBS system 
may comprise a small IS-inch satellite dish (which is an antenna for receiving a 
satellite broadcast signal); a digital integrated receiver/decoder (IRD), which 
separates each channel, and decompresses and translates the digital signal so a 
television can show it; and a remote control. Programming for a DBS system may 

25 be distributed, for example, by multiple high-power satellites in geosynchronous 
orbit, each with multiple transponders. Compression (e.g., MPEG) is used to 
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increase the amount of programming tliat can be transmitted in the available 
bandwidth. 

A digital broadcast center may be used to gather programming 
content, ensure its digital quality, and transmit the signal up to the satellites. 

5 Programming may come to the broadcast center from content providers (TBS, HBO, 
CNN, ESPN, etc.) via satellite, fiber optic cable and/or special digital tape. Satellite- 
delivered programming is typically immediately digitized, encrypted and uplinked to 
the orbiting satellites. The satellites retransmit the signal back down to every earth- 
station--or, in other words, every compatible DBS system receiver dish at customers' 

10 homes and businesses. In one embodiment, therefore, the communication network 
28 comprises this satellite communication link to the subscriber residences 14. 

Some programs may be recorded on digital videotape in the broadcast 
center to be broadcast later. Before any recorded programs are viewed by 
customers, technicians may use post-production equipment to view and analyze 

15 each tape to ensure audio and video quality. Tapes may then be loaded into a 
robotic tape handling systems, and playback may be triggered by a computerized 
signal sent from a broadcast automation system. Back-up videotape playback 
equipment may ensure uninterrupted transmission at all times. 

These modifications can be made to the invention in light of the above 

20 detailed description. The terms used in the following claims should not be 
construed to limit the invention to the specific embodiments disclosed in the 
specification and the claims. Rather, the scope of the invention is to be determined 
entirely by the following claims, which are to be construed in accordance with 
established doctrines of claim interpretation. 
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